Effective Subword Segmentation for Text Comprehension

Subword-Based Text Retrieval

Document retrieval in languages with a rich and complex morphology – particularly in terms of derivation and (single-word) composition – suffers from serious performance degradation with the stemming-only query-term-totext-word matching paradigm. We propose an alternative approach in which morphologically complex word forms are segmented into relevant subwords (such as stems, prefixes, suffixes...

A New Segmentation Technique for Omnifont Farsi Text

A New Segmentation Technique for Omnifont Farsi Text

Text Comprehension

The study of text comprehension is the study of the cognitive processes involved as people process (and ultimately understand) the words, phrases, and sentences that make up larger bodies of language use (e.g., stories, magazine articles, novels, and so on). This chapter provides an introduction to several aspects of research on text comprehension: the methods commonly employed to study text co...

Subword Variation in Text Message Classification

For millions of people in less resourced regions of the world, text messages (SMS) provide the only regular contact with their doctor. Classifying messages by medical labels supports rapid responses to emergencies, the early identification of epidemics and everyday administration, but challenges include textbrevity, rich morphology, phonological variation, and limited training data. We present ...